Root-mean-square error (RMSE) or mean absolute error (MAE): when to use them or not
نویسندگان
چکیده
Abstract. The root-mean-squared error (RMSE) and mean absolute (MAE) are widely used metrics for evaluating models. Yet, there remains enduring confusion over their use, such that a standard practice is to present both, leaving it the reader decide which more relevant. In recent reprise 200-year debate Willmott Matsuura (2005) Chai Draxler (2014) give arguments favoring one metric or other. However, this comparison can false dichotomy. Neither inherently better: RMSE optimal normal (Gaussian) errors, MAE Laplacian errors. When errors deviate from these distributions, other superior.
منابع مشابه
Root mean square error (RMSE) or mean absolute error (MAE)? – Arguments against avoiding RMSE in the literature
Both the root mean square error (RMSE) and the mean absolute error (MAE) are regularly employed in model evaluation studies. Willmott and Matsuura (2005) have suggested that the RMSE is not a good indicator of average model performance and might be a misleading indicator of average error, and thus the MAE would be a better metric for that purpose. While some concerns over using RMSE raised by W...
متن کاملRoot Mean Squared Error
• Predictive Accuracy Measures. These measures evaluate how close the recommender system came to predicting actual rating/utility values. • Classification Accuracy Measures. These measures evaluate the frequency with which a recommender system makes correct/incorrect decisions regarding items. • Rank Accuracy Measures. These measures evaluate the correctness of the ordering of items performed b...
متن کاملDetermination of Exponential Smoothing Constant to Minimize Mean Square Error and Mean Absolute Deviation
Exponential smoothing technique is one of the most important quantitative techniques in forecasting. The accuracy of forecasting of this technique depends on exponential smoothing constant. Choosing an appropriate value of exponential smoothing constant is very crucial to minimize the error in forecasting. This paper addresses the selection of optimal value of exponential smoothing constant to ...
متن کاملColloquium: Quantum root-mean-square error and measurement uncertainty relations
Recent years have witnessed a controversy over Heisenberg’s famous error-disturbance relation. Here we resolve the conflict by way of an analysis of the possible conceptualizations of measurement error and disturbance in quantum mechanics. We discuss two approaches to adapting the classic notion of root-mean-square error to quantum measurements. One is based on the concept of noise operator; it...
متن کاملOptimum thresholding using mean and conditional mean square error
We consider a univariate semimartingale model for (the logarithm of) an asset price, containing jumps having possibly infinite activity (IA). The nonparametric threshold estimator ˆ IV n of the integrated variance IV := ∫ T 0 σ sds proposed in [6] is constructed using observations on a discrete time grid, and precisely it sums up the squared increments of the process when they are under a thres...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Geoscientific Model Development
سال: 2022
ISSN: ['1991-9603', '1991-959X']
DOI: https://doi.org/10.5194/gmd-15-5481-2022